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Abstract 

■ In this paper, a distributed tracking control scheme with distributed estimators has been developed for a leader-follower 
multi-agent system with measurement noises and directed interconnection topology. It is supposed that each follower can 
only measure relative positions of its neighbors in a noisy environment, including the relative position of the second-order 
active leader. A neighbor-based tracking protocol together with distributed estimators is designed based on a novel velocity 
decomposition technique. It is shown that the closed loop tracking control system is stochastically stable in mean square 
and the estimation errors converge to zero in mean square as well. A simulation example is finally given to illustrate the 
performance of the proposed control scheme. 



Key words: Multi-agent systems, leader-follower, velocity decomposition, state estimation, stochastic noises. 



1 Introduction 

In recent years cooperative distributed control of multi- 
agent systems has been a research focus in control com- 
munity. An important control strategy among many 
others is the leader-following coordination among a 
team of agents. The leader- follower approach has been 
widely used in many practical applic ations such as 
forma ti on control in roboti c syste ms (jWang P. K. C.I 
(|l99ll ): iDas.Fierro. fcKumarl (120021)), unmanne d aeria l 
vehicle (UAV) formation jVanek.Peni.et all (j2005l) ; 
lAnderson.Fidan.et alj (I2008D). targe t track in g in sen- 



sor n etwork (|Gupta.Cao. feHaering] (|2008| ); Irlu. fcHul 
(|2008l) ). and so on. 

The major issues addressed in the study of leader- 
follower multi-agent systems i nclude the varieties of 
topological consensus condi tions (jJadbabaie.Lin. fcMorsd 
(|2003l ); IRen. fcBeardI (|2005t) ). t he roles of multiple lead- 
ers in guiding the followers (jLin.Francis. fcMaggiord 
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(120051) ;IShi. fcHond (120091)), the time-de layed control de- 
sign (|Hu. fcHond (120071); iLin.Jia. et~aTl (I2008D). a nd the 
distributed estimation strategies (|Fax. feMurravl (|2004f k 
lHong.Hu. fcGaol (|2006f)). A common feature of these 
existing works on distributed control for leader-follower 
multi-agent systems is that the measurement noises are 
not considered. However in practice, the measurements 
and information communication are always subject to 
noises and/or perturbations, such as sensor noise, chan- 
nel fading, quantization errors, etc. More recently con- 
sensus control problems with me asur ement noises have 
been s tudied in lLi. fcZhangl (|2009h and lHuang. fcMantonl 
(120091) with the fi x ed an d undirected network topology. 
iHuang. fcMantonl (I2009D proposed a consensus control 
for a leaderless multi-agent system with the first order 
discrete-time dynamics under noisy measurements and 
proved that the average consensus can be achieved in 
the sense of mean square by introducing a decreasing 
gain if the net work topology is a strongly connected cir- 
culant graph. ILi. fcZhangl ( 20091 ) extended the result to 
the first order continuous-time average consensus prob- 
lem and obtained a sufficient and necessary condition. 
To the best of our knowledge, there is no report in open 
literature on design of distributed control for a leader- 
follower multi-agent system with measurement noises 
and time- varying directed interconnection topology. 
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In this paper, we will consider a distributed control 
design for a leader-follower multi-agent system under 
partial and noisy measurements and time-varying di- 
rected network topology. A novel velocity decomposi- 
tion technique, inspired by the stocha s tic ap proxima- 
tion approach (|Nevelson. feHasminskiil (|1976|) ). and a 
distributed estimation algorithm for the velocity of the 
active leader have been proposed to deal with those 
partial and noisy measurements. It has been shown that 
the estimation is convergent in mean square and the 
resulting closed loop control system is stochastically 
stable in mean square. 

The remainder of this paper is organized as follows. In 
Section 2, some concepts in algebraic graph theory are 
briefly reviewed and a leader- following problem is formu- 
lated. In Section 3, a tracking control along with a dis- 
tributed estimation algorithm is firstly designed for the 
leader-follower multi-agent system based on the velocity 
decomposition technique. Then the stochastic stability 
of the closed-loop tracking error system is analyzed un- 
der switched directed topology. A numerical example is 
given to illustrate the distributed tracking control for the 
leader-follower multi-agent system in Section 4. Finally, 
some concluding remarks and future research directions 
are given in Section 5. 

Throughout this paper, we will use the following no- 
tations. / denotes an appropriate dimensioned identity 
matrix; 1 denotes a column vector with all ones. For 
a given matrix A, A T denotes its transpose; tr(A) its 
trace; ||A|| its Frobenius norm; X niax (A) and A m i n (^4) its 
maximum and minimum eigenvalues respectively. For a 
given set S, xs denotes the indicator function of S. E[-] 
is the expectation operator; col(-) denotes the concate- 
nation. For any given real numbers a and b, a A b denotes 
min{a, b}. 

2 Problem formulation 

2. 1 Preliminaries 

In order to describe the interconnection topology of a 
leader-follower multi-agent system, we need to intro- 
duce some pre l imina ries from algebraic graph theory 
iGodsil Mlovlel (12001ft . 

Let Q — (V, £) be a directed graph (or digraph 
for simplicity) consisting of a finite set of vertices 
V = {0, 1, n} and a finite set of arcs £ C V x V. The 
order of Q is the number of vertices in Q and denoted 
by \Q\. An arc of Q is denoted by which starts 

from i and ends on j and represents the information 
flow from agent j to agent i. A path in Q is a sequence 
io, ii-, ■ ■ ■ ,i q of distinct vertices such that (ij—i, ij) is an 
arc for j = 1, • • ■ , q. If there exists a path from vertex i 
to vertex j, we say that vertex j is reachable from vertex 



i. Furthermore, if there exists a path from every ver- 
tex to vertex j, then vertex j is a globally reachable 
vertex of Q. A digraph Q is strongly connected if there 
exists a path between any two distinct vertices. A di- 
graph Qf is a subgraph of Q if its vertex set V{G f ) C V, 
arc set £{G^) C £ and every arc in £(G f ) has both end- 
vertices in V. A subgraph Qf is an induced subgraph 
if two vertices of G are adjacent in G if and only if 
they are adjacent in G- An induced subgraph G that 
is strongly connected and maximal (i.e., no more ver- 
tices can be added while preserving its connectedness) 
is called a strong component of G- In this paper we will 
use the vertex set V(G*) = {1, • • • ,n} of subgraph G* 
to label the follower-agents. For a vertex i of Q' , we call 
Ni = {j : G £} the neighbor set of vertex i. A non- 
negative matrix A = [a^] e R" x ™ j s called an adjacency 
matrix of subgraph G if the element a.y associated 
with the arc is positive, i.e. a.y = 1 <^> £ £■ 

Moreover, we assume an = for all z 6 V. Notice that 
the adjacency matrix A may not be a symmetric matrix 

n n 

for a digraph. If ^2 o-ij — X] a ji f° r * = 1; ' ' ' > n i then 

the digraph Q* is called balanced. A diagonal matrix 
D = diag{di, d n } £ R" x " is called the degree ma- 

n 

trix whose diagonal elements di = ^ for i = 1, n. 

3 = 1 

Then the Laplacian matrix of subgraph Q$ is defined as 

L = D-A, (1) 

which may not be a symmetric matrix either. By this 
definition every row sum of the Laplacian matrix L is 
zero. Therefore, L always has a zero eigenvalue corre- 
sponding to a right eigenvector 1 = col(l, ■ • ■ , 1) G R". 
Moreover, if subgraph G is balanced, L has a zero eigen- 
value corresponding to a left eigenvector 1 £ R". 

When the digraph G is used to describe the interconnec- 
tion topology of a multi-agent system consisting of one 
active leader-agent and n follower-agents, we can define 
a diagonal matrix B = diag{a\o 1 • • • , a„o} £ R" to be 
a leader adjacency matrix, where a^o = 1 if follower i is 
connected to the leader across the communication link 
(i,0), otherwise, a^o = 0. 

If we define a new matrix H = L + B G R" , the following 
lemma plays a key role in sequel. 

Lemma 1 iHu, kHond f200H) ) The following state- 
ments are equivalent: 

(1) Vertex is a globally reachable vertex of digraph G ', 

(2) H is a positive stable matrix whose eigenvalues have 
positive real-parts; 

(3) Furthermore, if G^ is balanced, H + H T is a sym- 
metric positive definite matrix. 
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Remark 2 The topology connectedness in the sense that 
vertex is a globally reachable vertex of digraph Q im- 
plies that the information of the leader can be propagated 
over the multi-agent network. Obviously, this notion of 
connectedness is much weaker than the notion of strong 
connectedness. 

For the purpose of modelling the time- variation of the 
interconnection topology Q of the leader-follower multi- 
agent system, we adopt the following general assump- 
tions: 

Al There exists a switching signal a : [io,oo) — > V = 
{1,2,- •• ,N}, which is piecewise-constant. Here, N 
denotes the total number of all possible interconnec- 
tion topologies of the multi-agent system and to is the 
initial time. 

A2 If the time interval [to,oo) is constituted by an infi- 
nite sequence of bounded, non-overlapping, contigu- 
ous time- intervals [tj, tj+±) for j = 0, 1, • • ■ with to = 
0, there exists a positive constant r such that tj+i — 
tj > t. The number r is called a dwell time. 

Then during each time-interval [tj,tj+i) the digraph 
Ga(t) is time-invariant and denoted by Q v for somep G V . 

2.2 Leader-following problem 



agent can obtain the information of its neighbors pre- 
cisely. In addition, it was assumed that the intercon- 
nection topology of the followers are undirected. How- 
ever, these assumptions are not valid in most practi- 
cal situations due to various reasons, such as sensor 
and/or communication constraints, link variations. Mea- 
surement noises and time- varying directed graph have to 
be considered for control of leader-follower multi-agent 
systems. 

Since the velocity vo(t) of the active leader cannot be 
measured by followers, then each follower has to make 
estimation of Vo (t) for control design by using the noisy 
measurements from its neighbors. Our objective is to 
design a distributed control for the leader-follower multi- 
agent system under partial and noisy measurements and 
time-varying directed interconnection topology so that 
each follower can track the active leader and the velocity 
estimation errors are convergent to zero in the sense of 
mean square, i.e., 

lim E[(xi(t) - x (t)) 2 } =0, 

U) 

lim E[(vi(t) - «o(t)) 2 ] = 0, 

t— > oo 

where Vi(t) is the estimate of vo(t) for the ith follower. 
In this case, the closed loop system is said to be stochas- 
tically stable in mean square. 



In this paper we will study a distributed control de- 
sign for a leader-follower multi-agent system with one 
active leader-agent (just called leader in sequel for sim- 
plicity and labeled 0) and n cooperative follower-agents 
(just called followers in sequel for simplicity). Consider a 
tracking control problem for a multi-agent system where 
the followers are moving with the first-order dynamics 

±i{t) = Ui{t), (2) 

for i = 1, • ■ • , n, and the dynamics of the leader is de- 
scribed by the second-order differential equation 

Xo(t) = v Q (t), 

v (t)=a (t), (3) 
2/o (t) = x (t). 



The variables Xi(t),Ui(t) G R m (i = 1, • • • ,n) denote 
the states and inputs of n followers respectively while 
%o(t),vo(t) G R" 1 and a (t) G R m denote the position, 
the velocity and the acceleration of the the active leader 
respectively, and yo(t) is the only output. Here for nota- 
tion simplicity let m = 1. 

It was assumed in most existing works that an informa- 
tion exchange between agents is perfect, that is, each 



3 Distributed control of leader-follower system 

In this section we will focus on designing a dynamic 
tracking control for the leader- follower multi-agent sys- 
tem such that the closed loop control system is stochas- 
tically stable in mean square. 

The typical information available for each follower is its 
relative position with its neighbors. However as men- 
tioned in section of introduction, the real information ex- 
change among followers through a communication net- 
work is often subject to different kinds of constraints 
such as sensor noise, quantization errors, etc. In this 
case, the information available for the ith follower with 
respect to its neighbors can be described as: 

Zij(t) = ctij(t)(xi{t) - Xj(t) + QijUij(t)) G R, (5) 

where j G A/i (t) with A/i (t) being the neighbor set of fol- 
lower i at time t, aij(t) is the connection weight between 
agent i and agent j at time t, Wy(t) is an independent 
normal white noise, Qij > is the noise intensity. 

It is noted that since only the relative noisy position 
measurements Zij(t) can be used for the ith follower, the 
construction of a distributed estimator and controller 
turns out to be much more challenging than that in 
lHong.Hu. fcGaol (|2006f ) . To address the challenge, a novel 
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decomposition scheme of the velocity Vo(t) of the active 
leader is proposed as follows: 



«o(t) = a(t)v (t), 
v (t) = ao(t), 



(6) 



where vo(i) is a continuous diffcrentiablc function called 
nominal velocity and a(t) : [to, oo) — >• (0, oo) is a contin- 
uous diffcrentiable function satisfying J f a(s)ds = oo 
and J t °° a 2 (s)ds < oo. In addition, a(t) has an upper 
bound /i in [to,oo). We call ao(i) the nominal acceler- 
ation. Then the relationship between the acceleration 
ao(t) and the nominal one ao(i) can be expressed as 



a (t) = d(t)v (t)+a(t)ao(t). 



(7) 



Notice that a(t) in the decomposition (6) can be easily 
found for a continuous diffcrentiablc function vo(t), for 
example, a(t) = with its upper bound fx = 1 in 
time-interval [0, oo). In sequel we assume a(t) and ao(t) 
are precisely known beforehand. 

Remark 3 Letvi(t) = a(t)vi(t) be the estimate ofvo(t) 
by the ith follower. Ifvi(t) — Vo(t) — > 0, one has Vi(t) — 
Vo(t) —> since a(t) has an upper bound \i during time- 
interval [to,oo). 

On the basis of the decomposition (6), for the ith fol- 
lower with dynamics (2), we propose the following local 
dynamic control scheme with an estimator: 

' "uj(f) = -ka(t) £ Zij (t) + a(t)vi(t), 

Vi(t)=ao(t)-7M*) E *«(*)> 

I'EJViW 

where v, (i) is an estimate of the nominal velocity v (t) 
for i = 1, ■ ■ ■ , n, < 7 < 1, the gain constant > is 
to be determined in sequel. 

Remark 4 It is noted that the estimator for the nomi- 
nal velocity Vo (t) of the active leader is a distributed one 
based on measurements of relative positions of its neigh- 
bors. The rationale for the estimator is to collect the po- 
sition information of the leader within the neighborhood 
of the ith follower during a time period and then make 
a tendency prediction of the trajectory of the leader with 
the gathered historical data through an integrator. 

In the dynamic control (8) the neighbor set Wi (t) at time 
t of the ith follower may include the active leader. We 
divide the neighbor set Ni(t) into two subsets as follows: 

Mi{t)=M({t)UNl{t),i = !,■■■ ,n, (9) 

where Aff (t) denotes the follower- neighbor set and Afj (t) 



denotes the leader- neighbor set of follower i. Then apply- 
ing the dynamic control scheme (8) to system (2) yields: 

±i(t) = - ka(t){ ^2 o,ij(t)(xi(t) - Xj(t)) 

+ a i0 (t)(xi(t) - x (t))} - ka(t)a ia (t)g i0 LJio(t) 
— ka{i) ^2 a ij{t)@iiWij{t) + a(t)vi(t), 

Vi(t) =ao(t) - ika(t){ ^ aiJ (t)( Xl (t) - Xj (t)) 

+ a i0 (t)(xi(t) - x (t))} - jka(t)a M (t)g io uiio(t) 
--fka{t) ^2 <kj(t)QijUij(t)- 

(10) 

Let a(i, ■) denote the ith row of the adjacency ma- 
trix A = [dij] G R n x " of digraph Q i . Denote x = 
col(xi, ■ ■ ■ , x n ) £ R™, v = coZ(vi, • • • , v„) G R", w = 

C0l(uj w ,--- , W„o) G R™, U>i = C0l(Wu,-- - ,U)in) £ R" 

for i = 1, ■ • • ,n and uj = col(uio, ■ • ' , w n) G Ti n ^ n+1 \ 
Then system (10) can be rewritten in a compact form: 

x = —kaH a x + kaB a lxo — kaT, a LU + av. 
v = aol — "fkaH a x + jkaB ff lxo — jkaH^co, 

where a is the piecewise-constant switching signal, 
H a = L a + B a , L a is the Laplacian matrix associated 
with the switched subgraph Ql,B a is the leader adja- 
cency matrix associated with the switched digraph Q a , 
S = diag{g w , • • • , Quo}, £« = diag{gn,--- , g in } for 
i = 1, ■ • ■ ,n, and the matrix E CT is defined in equation 
(12). 

In order to show that all the followers can track the active 
leader, we firstly make two variable changes x — x — xqI 
and v = v — vol. According to the spectrum properties 
of graph Laplacian matrix, L a l = and then 

—H a x + B a lxo = —H a x. 

With system (3) and (11), we have 



x = —kaH a x — ka~E a ui + av, 
v = —~fkaH a x — jkaH a ui, 



(13) 



which can be rewritten in a compact form: 

i = F a e + n a uj, (14) 

-kaH„ al\ 
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a io£io 



fflll(?ll ■ ■ ■ dlnQln 



\ CLnOQnO 

= [B a T, diag{a(l, -)Si, ■ 



e R 



nx(n(n+l)) 



dnl Qn 1 ' " ' O'nnQnn J 

i(rv)£ n }] e iT xn(Tl+1) . 



(12) 



In sequel we will analyze the stochastic stability of 
system (14). Two cases: time-invariant leader- follower 
topology and time- varying leader-follower topology will 
be considered. 

3.1 Time- invariant topology 

When the leader-follower interconnection topology Q a (t) 
is time-invariant, the subscript a(t) will be dropped. 

Here we give a main result as follows. 

Theorem 5 // vertex is globally reachable in Q , then 
with the dynamic tracking control (8) each follower can 
track the active leader asymptotically in mean square, 
that is, 

lim E[{x % (t) - x a {t)f] =0, 



lim E[{ Vi {t) - v {t)f 



0. 



Proof: To facilitate analysis, we write system (14) in the 
form of Ito stochastic differential equation: 



de = Fedt + ndw, 



(15) 



where w(t) is an n(n + l)-dimensional standard Brown- 
ian motion. 



Choose a nonnegative function 

V(t) = e T {t)Pe(t), 

where 



P = 



P - 7 P N 
- 7 P P , 



(16) 



(17) 



and P is_a symmetric positive definite matrix satisfying 
H T P + PH = I n which is well defined due to Lyapunov 
Theorem and Lemma 1 . 

It follows from the definition of P in (17) and F in (14) 
that 



PF + F 1 P =: -Q 

^(l- 7 2 )/„ -P^ 



-«(*) 



If we choose 



k > 



27(1 -7 2 )' 



(18) 



(19) 



according to Schur complement formula, it can be shown 
that Q is positive definite. 

By Ito formula, we have 

dV{t)\ {15) =[e T (t)(PF + F T P)e{t) + tr{PVLVL T )]dt 
+ 2e T (t)Pfldw(t) 
= [-e T (t)Qe(t) + tr(Pnn T )]dt 
+ 2e T (t)Pfldw(t) 

-A min (Q) a ( t)v{t)dt + f)Qa 2 {t)dt 

(20) 



<- 



(1 + 7)Amax(P) 

+ 2e T (t)Pfldw(t), 



where p = n\ maK (P)k 2 (l - 7 2 ) max ||S<t|| 2 . 

cr£V 



For the third term in the last inequality of (20), we will 
prove that the mathematical expectation 



E 



\s)Pftdw(s)} = 0, 



(21) 



for all t > tn. 



For any t > 0, T > t , let t\° = mi{t > t : V(t) > 6} 
where S is a given positive number if V(t) > 5 for some 
t G [to,T]; otherwise, = T. From equation (20), one 
can get 



EiVitrxr^Xt 



E[V(t )} 



+ Po a (s)ds 
J t 

fT 

.2/ 



(22) 



<p / a (s)ds, 



la 



which implies that there exists a constant A to> T such 
that E[V{t ^l ) Xt<T i ] < A t T , Vt € [t Q ,T]. Then, by 
Fatou lemma [Chow. fcTeiche r (1997), we have 



sup E{V(t)] < A t0 . T . 

t <t<T 
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Thus, 



3.2 Time-varying topology 



E[f a 2 {s)V(s)ds] < sup E[V{t)] [ a 2 (s)ds < oo. 

Jto t <t<T Jo 



In addition, we have 



E[f \\e T ( S )Pn a \\ 2 d S }<p E[[ a 2 ( S )V(s)ds}. 

Jto Jto 



Now one is ready to present the following main re- 
sult about leader-follower tracking control under time- 
varying interconnection topology. 

Theorem 7 If vertex is globally reachable in Q a and 
Ql is balanced during each time-interval [tj,tj+i), then 
with the dynamic tracking control (8) each follower can 
track the active leader asymptotically in mean square. 



By the Ito integral formula FFriedman A.I (|l975h . we have 
the equation (21). 

Then based on equations (20) and (21), we have 
E[V{t)\ - E[V(t )] 

-Amm(Q) f t a(s)E[V(s)]ds + po f a * {s)ds . 
(1 + 7)Amax(f) Jto Jto 



Proof: Take a nonnegative function V(t) = e T (t)Pe(t) 
with symmetric positive definite matrix 



P 



In -"/In 
-J In In 



(23) 



It follows from the definition of P in (23) and F a in (14) 
that 



Then, by the comparison theorem iMichel. fcMillerl 
(|1977j ). we have 



PF„ + FiP 



E[V(t)} < E[V(t )]exp{- 



~A m i n (Q) 



i;(s)(is} 



(l+7)Ama X (P) Jto 

Po [ a 2 (s)exp{- Amin(Q) f a ^ db y ds 



< E[V(t )]exp{ 



(l+7)Amax(P) . 
— \nin(Q) f 
(l+l)X^(P)Jto 



+ Pa a 2 (s)ds. 



a(s)ds} 



Therefore, when t — > oo, J tg a(s)ds oo, a 2 (s)ds 
0, and so E[V(t)) -> 0. 

Since V(t) > (1 - 7)A min (P)||e(t)|| 2 , one has 



lim E(xi(t) - x (t)) 2 = 0, 



lim B(vi(*)-v (t)r =0. 



It then follows from < a(t) < fith&t lim E(a(t)vi(t)- 

t— >oo 

vo(t)) 2 = 0. The proof is thus completed. 



-a(t) 



fc(l- 7 2 )(H CT +Hj) -I n 



-In 



By assumptions in Theorem 7 and Lemma 1, H a 
is positive definite. If we choose 



k > 



1 



2 7 (1- 7 2 )A' 



(24) 



(25) 



where A 



min{A CT 



eigenvalues of H a + H^} > 0, 

according to Schur complement formula, it can be shown 
that Q a is positive definite. 

The rest of the proof are similar to those in Theorem 5 
by noting that V is a finite set, and hence omitted. 

Remark 8 In Theorem 7, the condition that Ql is bal- 
anced is a sufficient condition. The subsequent numeri- 
cal example shows that this condition is not necessary for 
the mean square convergence of the tracking errors. 



4 A simulation example 



Remark 6 From the proof of Theorem 5 it can be seen 
that the introduction of the gain function a(t) can en- 
sure equation (21) and E[V(t)] —tOast—} oo. Thus the 
tracking result presented in this paper is much more im - 
proved in comparison with that in \Hona.Hu. fc Gao\ I 200 A) 
for the leader-follower multi-agent system with directed 
interconnection topology. 



In this section a numerical example is given to illus- 
trate the proposed dynamic tracking control algorithm. 
Consider a leader-follower multi-agent system with one 
active leader and three followers. Suppose that the 
leader-follower interconnection topology Q a is time- 
varying with switching rule: Q\ , Qi , Si , Qi , ■ ■ • , where 
Qi and Q- 2 are described in Fig. 1. Then one has the 
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1 

o 



o- 

2 







O 



-o 



(a) Qi and Q[ 



o 

2 



(b) Q 2 and <5| 



o 

3 



Fig. 1. V = {0, 1, 2, 3} and V(G f ) = {1, 2, 3} 
following Laplacian matrices 









(i -i o\ 


Li = 


-1 1 


M = 


-1 1 




{0 -11) 




\0 Oy 



and the leader adjacency matrices B\ = diag{l, 0, 0} 
and i?2 = diag{l, 0^1}. It is not difficult to have the 
minimal eigenvalue A = 0.3187 for Hi = L\ + Si and 
i?2 = £2 + Bi- 

In the control (8) we choose a(t) = 7 = 0.8 and 
k = 6. In addition, let the intensity g^j = I when = f . 
For system (14), the initial value of e(t) is taken ran- 
domly as col(2, 1, — 1, -0.2, -2, 0.2). Then the tracking 
errors Xx(t),X2(t) and Xs(t) are shown in Fig. 2. It can 
be seen that the tracking control (8) ensures that the 
followers track the active leader under noisy measure- 
ments. Notice that even though digraph Q[ is not bal- 
anced, the tracking errors still converge in mean square. 



Fig. 2. The evolution of tracking errors 
5 Conclusions 

In this paper we have studied the leader following prob- 
lem of a multi-agent system with measurement noises 
and directed interconnection topology. The neighbor- 
based distributed control scheme with distributed esti- 
mators has been developed. Algebraic graph theory and 
stochastic analysis have been employed to analyze the 
mean square convergence of the tracking errors. One pos- 
sible future research topic is to study the leader- following 



problem in a noisy environment when the dynamics of 
each agent is described by a more general linear system. 
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